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Abstract 

The Random Orthogonal Model (ROM) of Marinari-Parisi-Ritort 



1 13, 14] is a model of statistical mechanics where the couplings among 
the spins are defined by a matrix chosen randomly within the orthogo- 
nal ensemble. It reproduces the most relevant properties of the Parisi 
solution of the Sherrington-Kirckpatrick model. Here we compute 
the energy distribution, and work out an extimate for the two-point 
correlation function. Moreover, we show exponential increase of the 
number of metastable states also for non zero magnetic field. 



1 Introduction: review of the model 
and outlook 



Random (symmetric) matrices out of a given ensemble can be taken 
as interaction matrices for Ising spin models. The most famous exam- 
ple is the Sherrington-Kirckpatrick (SK) model of spin glasses, where 
the elements are i.i.d. Gaussian variables with properly normalized 
variance. Aim of this paper is to discuss a very specific example of 
these spin glass models, which also share some interesting connections 
with number theory, and show how random matrix theory could be 
useful to investigate its properties. 

For the sake of simplicity, let us start with a very concrete question: 
let N > 1 be a positive integer and denote Ejy the space of all possible 
configurations of N spin variables 

Sat = {a = (ax, . . . , oat) , Uj = ±1}, \T, N \ = 2 N . 
Given k = 1, . . . , N — 1, denote the correlation function: 

N 

Cfe(f) = a j a j+ki where j + k := (j + k — 1 mod N) + 1, 
j=i 

and define the Hamiltonian function 

, N-l 

H(a) = —— Y Cl 
K ' N-l k 

k=l 

For each N the ground state of the Hamiltonian H can be looked at 
as the binary sequence with lowest autocorrelation and finding it will 
have some relevant practical applications in efficient communication 
(see 0] and references in fl3|| ). 
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It is remarkable that no concrete procedure for reproducing the 
ground state for generic N is known, but ad hoc constructions based on 
number theory exist for very specific values of N: if N is prime number 
with N = 3 mod 4, then the sequence of the Legendre symbols]] (crjy = 

1) 

<Tj ■= (A?) =^ (N " 1) modN, j = l,...,N-l 

gives the ground state of the system || 13]. 

Through the use of the discrete Fourier transform, it is not difficult 
to see |l^, [l6|] that the previous problem is in fact equivalent to finding 
the ground state for the so called Sine model, which represents our 
starting point: 



'lj 0~iO~j ■ 



1 - 

Here J is the following N x N real symmetric orthogonal matrix with 
almost full connectivity: 



/ 2ir ij 
V1 + 27V \2ivTl 



J ij = P, . ^ Sil1 ( oAr , ^ ) ! h3 = h ■ ■ ■ , N 



Here again, if 2iV + 1 is prime and TV odd, the Legendre symbols 
Uj = j N mod 2N + 1 give the ground state of the system for these 
very specific values of N. 

A natural approach is to extend the study of the ground state to 
the more general thermo-dynamical behavior of the model in terms of 



1 = 1, if j = x 2 mod N and —1 otherwise. 
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the inverse temperature (3 = A. As usual, the two basic objects are: 

the partition function Zj(j3) := ^ e~^ H ^ a \ 
and the free energy density (at the thermodynamical limit) 



It is important to remark now that even if there is no randomness 
in the system, the ground state of the model looks like an output of 
a random number generator and the numeric of its thermo-dynamical 
properties resemble the one of disordered systems. This observation 



was in fact the starting point of an approach developed in jl^, 14, 16] 
where this model is seen as a particular realization of a disordered 
model where the coupling matrix is chosen at random out of a suitable 
set of matrices: 

Definition 1 The Random Orthogonal Model (ROM) with magnetic 
field h > is the disordered system with energy 

Hj(o) = -^jY^JijOjOi + h^Taj, (1) 

ij 3 

where the coupling matrix J is chosen randomly in the set of orthog- 
onal symmetric matrices^ 

J = ODO' 1 , 

Here O is a generic orthogonal matrix and D is diagonal with entries 
±1. The numbers ±1 are the eigenvalues of J. 



2 In the ROM model generic matrices have non zero diagonal elements. Often these 
terms will be set to zero and orthogonality will be reconstructed in the large N limit. 



The natural probability measure [x on this set is the product of 
the canonical Haar measure on the orthogonal group by the discrete 
measure on the diagonal terms. 



We will use the notation (•) to denote the average with respect the 
measure [i. In particular, we are interested in the quenched (i.e., the 
average is performed after taking the logarithm) free energy density: 

</jG0)> = - ton -L(logZj(p)) (2) 

N^oo ply 

Average over the ROM disorder is performed by the following fun- 
damental formula, which has been obtained by adapting the results in 
fl2| (see also ) valid for the unitary case to the orthogonal one |14j . 
For any N x N symmetric matrix A: 

(expjtr(^)}) = exp{Ntr(G(^}+R N (A), 

(3) 




where Rn — > in the thermodynamical limit N — > oo, the A,-'s are 
the (real) eigenvalues of i • A and G(x) is given by 



cm = \ 



V TT^-In(l±4±^)-1 



The same formula is exact for the SK model, i.e Gaussian inde- 
pendent symmetric couplings, with 

Gsk(x) = — 
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Note that G(x) = Gsk(%) + o{x). For example, up to the 10-th order 



The ROM model has been chosen in a such a way that, at least for 
not too small temperature, the deterministic Sine model and the one 
with quenched disorder share a common behavior. More precisely, 
the couplings are always of order N~z; the diagrams contributing 
to the thermodynamical limit of the high temperature expansion for 
the free energy density have the same topology and they can all be 
expressed in terms of positive powers of the trace of the couplings. 
By construction, the high temperature expansion of the free energy 
density fj(/3) in powers of (3 is then independent of the particular 
choice of the symmetric orthogonal matrix J and it does coincide 
with the annealed average w.r.t. ji. In particular |16[|; 



Besides SK and in general the large class of p-spin models, where 
couplings have a gaussian distribution, the ROM model provide an- 
other interesting class of disordered mean- field spin glass. This model 
has received considerable interest in recent years, especially in the con- 
test of structural glass transition. Indeed it can been seen as the ran- 
dom version of a wide class of models (for example the fully frustrated 
Ising model on a hypercube or the above mentioned sine model) which 
despite having a non-random Hamiltonian display a strong glassy be- 
havior |3|, [l^, g]. This model has been studied in the framework of 




P{fM) = log2 + G(/3). 
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replica theory Jj^j , where it was shown that replica symmetry is bro- 
ken and there are many equilibrium states available to the system. 
Mean field (TAP) equations have been derived for this model by re- 
summing the high temperature expansion and the average number of 
solutions of these equations has been studied in ref. . 

It is a well established fact that the observed properties of mean- 
field spin glass models are due to the large number of metastable states 
the system possesses. Despite being not fully justified from a mathe- 
matical point of view, the Parisi scheme of breaking replica symmetry 
furnishes a clear picture of equilibrium statistical properties: states 
with similar macroscopic behavior have vastly different spin configu- 
rations, and have large relaxation times for transition between them. 
As a consequence, the ground state is accessible only on very long 
time scales. It is worth mentioning that rigorous results validating 
the Parisi solution have been accumulating in recent times. 

For example, Guerra and Toninehi|lG|] have proved the existence 
of thermodynamical limit, i.e. the existence of the limit for quenched 
average of the free energy (eq. ||). See also || where the result has 
been extended to general correlated gaussian random energy models. 



Finally, more recently |11], Guerra showed that the Parisi Ansatz rep- 
resents at least a lower bound for the quenched average of the free 
energy. 

However there is not yet an unambiguous way to identify those 
metastable states which are relevant for thermodynamics in the infi- 
nite volume limit. At zero temperature the metastable states can be 
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defined as the states locally stable to single spin flips (definition re- 
called in Section 3 below) and the calculations are relatively straight- 
forward. Complete analysis of the typical energy of metastable states 
and of the effects of the external field have been undertaken both 
for the SK model |L9], [L8|, [7j and for general p-spin model [jllj. The 
zero temperature dynamics for the deterministic Sine model has been 
instead studied in M. 

At non-zero temperature the identification is less obvious and most 



studies J|, 17] rely on the counting of the number of solutions to the 
celebrated TAP equations |2C]. According to the general belief, one 
can associate to each metastable state a solution of the TAP equation, 
but the inverse is not true: a TAP solution corresponds to a metastable 
state only if it is separated from other solution by a barrier whose 
height diverges with the volume. 

It appears, however, that even the calculations at zero temperature 
in a presence of external field have not been carried out. One expects, 
in analogy with SK model, the existence of an AT line |IJ indicating the 
onset of replica-symmetry breaking. In this paper we study at length 
the effects of the magnetic field on the structure of local optima of 
the energy landscape. We are able to use these results to shed further 
light on the nature of the AT instability at zero temperature. 

In the next Section [2] we study the statistics of energy levels over 
the whole configuration space. We compute energy distribution of a 
generic spin configuration and the pair correlations for a given couple 
of spin configurations with a fixed overlap. In Section |3| we analyze 



<s 



metastable states at zero temperature, also in a presence of an external 
field. 



2 Statistics of energy levels 



We start by analyzing the statistical features of the landscape gener- 



zero magnetic field h = 0. Let us begin with the energy distribution 
for a single fixed configuration. 

2.1 Distribution of energy 

Let a = (<Ti, <72, . . . , ctjv) denote a given configuration with energy 
Hj(a). The probability P a {E) is then given by: 



Due to gauge invariance, the probability P a {E) does not depend on 
the spin configuration a and it will be denoted just by P(E), in fact: 
H{J,a) = H(J',a') and P{J) = P(J') where = JijO^Ojo'y 
Introducing the integral representation for 5 function 



ated by the energy function (||) . In this section we will always consider 



P a (E) := (S(E-H(J,a))} 




we get 



'+ioo 



dk e kE (e% ^ 



,N 




) 



— lOO 
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and we can apply formula (|3|) to average over disorder considering the 



matrix As 



It is easy to prove that A admits only one non-zero, simple eigen- 
value A = kN, so that 



P(E) 



1 



dk exp 



N 



fkE 



+ G(k) 



27ri J —ioc 

In the large-iV limit the integral can be evaluated using the saddle- 
point method. Clearly, the equation 

k 



§ + G'(k) - - + r+ ^ T __ 







admits the solution k = 4 fJz^pa • 
This gives: 



Prom(E) ~ exp 



exp 



If f +0(t) 



f) 2 f 

" iV iV 3 



(4) 



16 E 6 



(5) 



apart for an unimportant constant, not predicted by the saddle-point. 
As a comparison, in the case of SK model one finds exactly the gaus- 
sian distribution: 



Psk(E) ~ exp 



El 

' N 



To check the validity of formula (||) which has been used to aver- 
age over disorder, we computed Prom(E) for a relative small ROM 
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(N=100) numerically. For a given spin configuration, random disor- 
der realizations J = ODO -1 were generated by using an orthogonal 
matrix O obtained from a gaussian matrix by applying Gram-Schmidt 
orthogonalization algorithm and coin tossing for the diagonal D. The 
resulting distribution of energies was binned and is shown as the data 
points in Fig. (|l|). 



0.06 




-50 -30 -10 10 30 50 



E 

Figure 1: Probability distribution function Prom(E) for ROM model (full 
curve). Simulation for a N = 100 ROM (data points). For a fixed spin con- 
figuration, 10 6 realizations of disorder were generated. 

As it should be, the support of Prom{E) is almost all in the inter- 
val [—N/2, N/2]. Indeed, the orthogonality of J imposes simple bound 
on the energy of any spin configuration: the lower bound —N/2 (resp. 
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upper bound N/2) is reached if and only if a is an eigenvector of J 
relative to eigenvalue +1 (resp. —1). 

2.2 Two-point Energy Correlation 

We consider now the probability P aT (Ex, E2) that two configurations 
a,r G S^r have energies E\ and E2 respectively. Gauge invariance 
implies that this probability can only depend on the overlap between 
the two configurations: 



Consider now the matrix Aij = kiOi<jj-\-k2TiTj which has two non-zero 
simple eigenvalues 



q ( a > ^ = AT ^ aiTi 



Proceeding as before, we get: 



P<t,t (Ei, E 2 ) 



(S(E 1 -H(J,a))d(E 2 -H(J, T ))) 





Applying formula (||) we obtain: 




exp TV 



k x Ex 



+ 



k 2 E 2 
N 



+ G(\ + /N) + G{\-/N) 



) 



N 
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The saddle-point method yields the equations: 



JV iV y N' dki 



N y N ' dki 



1,2 



For the SK model, one immediately find: 



§ + ^i + M 2 ) = 0, ^ + I(fc 2 + ^ 2 ) = 
with solutions: 

_ 2(£i - £ 2 q 2 ) _ 2(£ 2 - £ ig 2 ) 

1 ^(-l + g 4 )' 2 7V(-l + g4)- 

This yields the well known || (ff,r G Ejv fixed, with overlap q): 



Psk(E\,E 2 



Nit 



exp 



{Ei + E 2 y 

'2N(l + q 2 ) 



exp 



(£i-£ 2 ) 2 
2JV(l-g 2 ) 



E\ — E 2 



V2(l + g a ); aA VV2(1 -?*)>/■ 
For asymptotically uncorrelated configurations (? = 0, one clearly get 
a product measure, whereas one recover complete degeneracy when 
q = l: 

P SK (E 1 ,E 2 ) = Psk{E x ) ■ Psk(E 2 ), q = 0, 



(7) 



and 



(8) 



(9) 



P S k(E u E 2 ) = P SK {Ei) ■6{E 2 -E 1 ), q= 1. 
In generale, one has 

/ / E 1 E 2 dP SK (E 1 ,E 2 ) = 
J— 00 J— 00 ^ 

For the ROM model, it is immediate to see that the analog of 
(|8|) and (J9|) hold true with the single energy distribution Prom{E) 
given by (0). For generic value of < q < 1, a first crude estimate is 
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achieved by using the stationary points of the gaussian approximation 

2 4 

and G(x) = \ — %- to evaluate the exponent. This yields: 
P ROM (E 1 ,E 2 ) ~ P SK (E 1 ,E 2 ) ■ Ex P [-$ q (E 1 ,E 2 )}, 

where 

8E 3 E 2 q 4 -SE x Elq A + E\ (l + 2q 2 -q 4 ) 



$ 9 (£i,£ 2 ) := -2 
4 



AT3 (_1 + g 2)2 (1 + ?2 )4 
E 2 A (l + 2q 2 -q 4 )+2E 1 2 E 2 2 q 2 ( 2 - q 2 + Aq 4 + q e ) 



N 3 (-1 + q 2 ? (1 + g 2 ) 4 
Further corrections can be now calculated, but we do not known 
a systematic way of doing it at all orders. 



3 Zero temperature metastable states 

Metastable states at zero temperature are defined as the configurations 
whose energy can not be decreased by reversing any of the spins || . 
Since the energy change AEi involved in flipping the spin at site i is 
given by 

AEi = 2 ^2 JijcncFj + ha}j 

the constraint a configuration a must satisfy in order to be metastable 
is 

JijOiOj + hoi > Vi = 1, . . . , N 

j 

The average number of metastable configurations {M(e,h)) with a 
given energy density e = E/N is then 
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N 

(En 

M i=l 



S \Ne + - Jij^iVj + h^ai 



(10) 



One should really calculate the average value of the logarithm of the 
number of metastable states, this being the extensive quantity, and 
hence introduce replicas; indeed, as pointed out in 0, the introduc- 
tion of a uniform magnetic field should introduce strong correlations 
between the metastable states. However, we shall proceed with the 
direct calculation of (M(e, h)) as it suffices to bring out the most rel- 
evant features of the problem. 

Introducing integral representations for 5 functions we have 



(M(e,h)) 



2m 



M 

N 

n / < /A > 



+ io ° dh 

-ioo 27TZ 



To apply the formula (|3|) for averaging over disorder we define the 
matrix Ay = (f + hi) OiOj + (f + kj) PjO'i- The non-zero eigenvalues 
of Aij are easily calculated and read 



so that we obtain: 



\ 



(M(e,h)) 



(<TJ i = l 



- / :x_) 27TZ 



^\ ki(h<Ji-\i) 



15 



> j A 
1 



G 



N 



1 



\ 



Performing now the trace over spin configuration, denning 



+ 



v = — V (- + h 

AT \ ' 



N ^ \2 

and imposing the constraints via two Lagrange multipliers, we have 



(M(e,h)) 



(2m) 



J r+ioo r+ioo r+ioo r+ioo r+ioo 

—3 / dz I dv dw I dx j dy 

J —too J — zoo J —ioo J —too J —ioo 
2 "1 



zx yz , . 

exp {N[—xv — yw + G(v + \/w) + G(v — \fw)\] 

N 



n 

i=i 



/+ioo flu. „ 
^ e w*?+*i(*-Ai+!/*) cosh + m\ 
-ioo 



The integrals over the fcj are now gaussian 

^ r+ioo r+ioo r+ioo r+ioo r+ioo 

(Af(e, h)) = - — -3 / dz I dv I dw / dx j dy 

(Z7TiJ J —ioo J —ioo J —ioo J —ioo J —ioo 

{ZX VZ^ 1 
N[ze + — + y —]\ 

exp {iVf-xv - yw + G(v + y/w) + G(u - v 7 ^)] } (IS 

N 



n 

i=i 



00 j 

(iAj — — 





e e 4 v + e e 4 f 



and the integrals over the Aj can be performed in terms of the com- 
plementary error function 



erfc(x) 



2 f°° 

IT ,; ., 



e~* 2 dt 
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so that we find: 

^ r+ioo r+ioo r+ioo r+ioo r+ioo 

(Af{e, h)) = — — —j / dz dv dw / dx dy 

ylTXl) J —ioo J —ioo J —ioo J —too J — 200 

{zx VZ 2 ] 
N[ze + — + y —]\ 

exp {N [-xv -yw + G(v + \fw) + G(v - y/w) (14) 

+ -(i(^(-^) + ^(- =d ^ i ))) n 

As usual the calculation is concluded by carrying out a saddle-point 
integration. The r.h.s. of Eq. di~4| ) is to be extremized with respect to 
the five variables z,v,vu,x,y. 



3.1 Total number of metastable states 

Here we study the total number of metastable states (J\T(h)) (irrespec- 
tively of the energy) as a function of the field. Writing 

log{M(h)) = A(h)N + B(h), (15) 

A(h), in the thermodynamical limit (N — > oo), can be calculated by 
setting z = in Eq. fll4|), which becomes: 



I r+ioo r+ioo r+ioo r+ioo 

(J\f(h)) = — — / dv dw / dx dy 

yZTXl) J —ioo J —ioo J —ioo J —ioo 

exp {N [—xv — yw + G(v + \/w) + G{v — \/w) 

+hl (K erfc( -^l ,+erfc( -^ ) )) |, (i6) 

In the case of the SK model one recover the well now one-variable 
saddle-point equation 0: 

exp[— x 2 /2] cosh(/ix) 
X = J~exp[-i 2 /2] cosh{ht)dt 
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If x c is the solution to the previous equation: 

1 / 1 f°° 

A SK (h) = log(2) - -(x 2 c +h 2 ) + log \j2^y/2 J exp[-t 2 /2] cosh(M) dt 

in particular A$k(0) ~ 0.199, whereas for large h one has x ~ ( — J e 



and consequently Asii" ~ \e h2 (see Fig.(|2D) 



Ask 
. 2— . 

0.15 

0.1 

0.05 



Figure 2: A SK {h) 

We now turn to the ROM model. We first perform a numerical in- 
vestigation by doing an exhaustive enumeration of spin configurations 
and keeping track of metastable states. The system-size dependence 
of log(N(h)} is plotted for different values of h in Fig. (||, left). The 
data are fitted to formula (|l^), ignoring possible finite size corrections. 
The resulting AnoM{h) are showed in Fig. (||, right) as data points. 
Moreover, the saddle point equations corresponding to ( |l6|) were solved 
numerically, and the result is shown by the solid curve in (Fig. (||, 
right)). The agreement between theory and simulations is very good 
in spite of the fact that we used admittedly small systems (N < 30). 
As one would expect, metastable states disappear as the magnetic 
field is increased, since it introduces a tendency towards ferromagnetic 
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10 15 20 25 30 35 40 



Figure 3: Numbers of metastable states. (Left): Their dependence on system 
size N at different magnetic field, see legend. (Right): Data points shows the field 
dependence of -A.ro Af(M obtained from the fits, while the full curve indicates the 
analytical results in the thermodynamical limit. 
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behavior. Most of the processes are the confluence of a metastable 
state to another with a larger drop of free-energy. 

Note that we have Arom(0) ~ 0.285, while the asymptotic behav- 
ior for large magnetic field h does coincide with the gaussian case (see 
Fig.(l,Fig.(l )). 




0.5 



2 . 5 



Figure 4: Asx{h) (bottom blue), AromQt) (middle red ), h (top) 



This indicates that Arom(^) still remain non-zero for arbitrarily 
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ROM 

0.4 
0.2- 

h 

-0.2 

1 2 3 4 5 

Figure 5: Plot of e h2 ■ A^oM{h) for values of the magnetic field h between 1 and 
5. 

large h and hence for any finite value of the external magnetic field the 
number of metastable states grow exponentially with the system size 
N. As pointed out by |?]] for the SK model, this result is in agreement 
with the observation that the AT instability occurs for all finite h at 
zero temperature. 
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